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Introduction 


.  .1 


The  concept  of  Management  Information  Systems  (MIS)  is 
gaining  an  increasingly  complexity.  In  some  recent  papers 
[  1] /  [2]  reporting  on  research  done  in  area,  the  relationship 

between  idealistic  MIS  and  real  human  needs  is  studied  in 
details  and  from  there  the  requirements  for  effective  MIS 
clearly  defined.  But  little  has  been  done  so  far  to  provide 
t  ools . 


Everybody,  however,  seems  to  agree  that  the  decision 
function  of  an  MIS  should  rely  on  models 

'in  order  to  mechanize  decision-making,  it  is 
necessary  to  represent  by  symbols  the  system 
to  be  controlled,  and  then  to  find  a  way  of 
manipulating  these  symbols  so  as  to  obtain  a 
desirable  decision.  A  symbolic  representa- 

i 

tion  of  the  system  which  serves  this  purpose 
is,  of  course,  called  a  model'  ([3]  p.6) 

Studying  the  implications  of  the  model  approach  together 
with  the  necessary  human  interface,  Gorry  and  Morton  endorse 
first  the  observations  made  by  Simon  on  human  problem-solving, 
calling  for  a  3-steps  procedure  in  any  decision-making  process: 
the  Intelligence  phase  searching  the  environment  for  conditions 
calling  for  decision,  the  Design  phase  inventing,  developing, 


' 


’ 
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and  analyzing  possible  course  of  action,  and  the  Choice  phase 
selecting  a  particular  course  of  action  from  those  available. 
They  arrive  them  at  the  following  conclusions: 

In  Intelligence,  one  would  need  the  ability 
to  scan  data  sets  ...  The  design  phase  would 
require  an  ability  to  build  models  or  test  the 
structure  of  existing  ones.  ...  The  Choice 
phase  requires  an  ability  to  specify  criteria 
and  to  test  possible  solutions  against  them 
.. . '  ([1] ,  p.  25) 

The  practical  consequences  of  this  analysis  are  clear 

when  operating  an  MIS,  decision  models,  banks  should  be 

available,  together  with  the  more  conventional  data  banks, 

and  they  should  be  equally  accessible  service  functions.  To 

[2] 

quote  from  Will  ,  the  model  banks  should  be  as  open-ended 
as  the  data  banks,  and  incorporate  creation,  updating,  and 
maintenance  facilities.  Finally  they  should  be  characterized 
by  strong  evaluative  capabilities,  as  well  as  considerable 
flexibility  in  criteria  specification.  They  could  be 
partially  under  system  control  but  mainly  in  the  hands  of 
the  user.  'The  model  bank  is,  therefore,  meant  to  facilitate 
a  multitude  of  intelligence  processes  in  a  man-machine  mode 
of  operation'  ([2],  p.  23). 


. 


As  a  way  of  achieving  these  goals,  DYLAN,  a  conver¬ 
sational  Dynamic  Programming  System,  allows  the  decision  maker 
to  build  Dynamic  Programming  decision  models  on-line,  store, 
retrieve,  and  update  them,  and  finally  perform  sensitivity 
analysis  of  policy  determination  or  strategy  evaluation. 

This  report  is  organized  so  that  a  non  computer-oriented 
reader  should  easily  find  his  way  through  sections  2  to  6 
included.  A  more  technical  description  will  be  found  in 


section  7,  to  serve  potential  users. 
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'The  Sequential  Decision  Problem 


.  .4 


Although  Dynamic  Programming  can  be  applied  to  very 
general  discrete  optimization  problems  (see  [5]),  only  sequen¬ 
tial  decision  models  are  considered  here.  This  is  a  convenient 
restriction  because  the  canonical  form  for  sequential  decision 
problems  can  be  fully  described  by  means  of  a  few  standard  con¬ 
cepts  .  This  section  gives  an  intuitive  idea  of  the  class  of 
problems  covered  by  the  system.  More  mathematically  oriented 
definitions  can  be  found  in  [6]  and  [7]. 


A  sequential  decision  problem  is  a  model  built  to  fit 
situations  where  the  following  standard  concepts  can  be  iden¬ 
tified: 

I.  a  PERIOD  index,  numbering  the  successive  stages  of  a 
dynamic  environment. 

example:  k  denoting  the  months  of  a  year 

i 

II.  a  STATE  variable  (indexed  by  the  period)  describing 
the  state  of  the  system  at  every  stage. 

example:  inventory  (k)  giving  the  level  of  an 

inventory  at  stage  (k) 

III.  a  DECISION  variable  (indexed)  expressing  the  decision 
that  must  be  made  at  each  stage. 

example:  production  (k) ,  the  quantity  to  be  pro¬ 


duced  at  stage  (k) 


’ 


' 


IV. 


a  TRANSITION  relation  indicating  how  the  STATE 
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variable  at  a  given  stage  can  be  deduced  from  the 
knowledge  of  the  STATE  and  DECISION  variables  and 
some  other  fixed  DATA  at  the  previous  stage, 
example:  inventory  (k+1)  =  inventory  (k)  + 


production  (k)  -  sales  (k) 


V.  a  return  FUNCTION  giving  the  return  -  cost  or  profit  - 
associated  with  each  possible  move  defined  by  a  pair 
of  STATE  and  DECISION  and  some  other  DATA, 
example:  cost  (k)  =  inventory  (k) *  maintenance  (k)  + 

production  (k)  *rate  (k) 

The  statement  of  the  problem  is  then  the  following:  given 
an  initial  state  at  the  first  period,  find  the  sequence  of 
decisions,  called  an  optimal  policy, that  will  bring  the  sys¬ 
tem  to  a  (possibly  fixed)  final  state  at  the  last  period,  in 

t 

such  a  way  that  the  sum  of  the  returns  associated  with  each 
move  will  be  optimized  (minimized  or  maximized)  . 


As  possible  extensions,  one  can  incorporate  the  two 
following  concepts: 

VI.  a  CONSTRAINT  relation  which  expresses  conditions  to 
be  verified  between  the  different  variables  at  each 
stage. 

example:  inventory  (k)  +  production  (k)  -  demand 

(k)  >  0  so  that  the  demand  should  always 


be  satisfied. 


_ 

. 


' 


- 
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VII.  a  RANDOM  variable  (indexed)  whose  values  at  each  stage, 
unknown  in  advance,  describe  stochastic  effects  on  the 
model . 

example:  demand  (k)  the  unknown  demand  for  goods  at 

stage  k 

In  the  case  where  there  is  a  random  variable  described 
by  a  probability  distribution,  the  objective  is  then  to  opti¬ 
mize  the  expected  value  of  the  total  return,  and  a  set  of 
optimal  decisions,  called  optimal  strategy,  can  be  given  for 
each  possible  state  that  can  occur  as  the  result  of  the 


stochastic  effect. 
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The  Conversational  System 
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The  Conversational  Dynamic  Programming  System  DYLAN 
(an  acronym  for  Dynamic  Language)  is  designed  to  handle,  in 
an  interactive  mode/  any  sequential  decision  problem  given 


by  its  standard  concepts  just  described. 


The  basic  structure  of  DYLAN  is  as  follows:  In  the 
first  part  of  the  program,  which  could  be  called  the  decoder , 
the  user  is  asked  to  define  his  model.  Three  modes  of  opera¬ 
tions  are  available,  automatic,  retrieve  or  manual .  In  the 
automatic  mode,  the  computer  itself  asks  the  user  to  com¬ 
municate,  i.e.  to  type,  all  the  information  it  needs  for  a 
complete  formulation  of  the  model.  Its  questions,  referred 
to  by  keywords,  logically  display  all  the  standard  concepts 
of  the  canonical  form,  and  the  answers  must  be  given  in  a 
PL/1- like  form.  The  model,  ready  for  computation,  can  then 

l 

be  stored  for  further  reference  and  use. 


The  retrieve  mode  permits  to  access  and  load 
previously  defined  model.  Switching  finally  to  the  manual 
mode  of  operation  enables  the  user  to  type  any  of  the  key¬ 
words  refering  to  the  computer's  questions  and  then  to 
redefine  the  corresponding  data.  Thus  it  is  possible  to 
take  into  account  new  information  as  it  becomes  available 
(real-time  processing) ,  or  to  adjust  the  estimation  of  free 
parameters.  This  sensitivity  analysis  is  not  restricted  to 


- 


numerical  data.  A  complete  flexibility  in  criteria  speci¬ 
fication  is  achieved  by  entering  different  return  functions, 
constraint  relations,  and  so  on. 

In  the  second  part  of  the  program,  which  could  be 
called  the  executer ,  the  model  is  optimized  by  the  algorithm 
of  dynamic  programming,  at  the  request  of  the  user. 

The  output  consists  of  the  (expected)  value  of  the 
total  return,  followed  by  the  optimal  policy,  in  the  case 
of  a  deterministic  model,  or  the  optimal  strategy  for  a 
specified  state,  in  the  case  of  a  stochastic  model. 


■ 
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The  Formulation  of  Models 
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The  following  is  the  list  of  the  questions  asked  by 
the  system,  together  with  the  format  in  which  to  give  the 
answers.  This  list  essentially  duplicates  the  list  of 
standard  concepts  given  earlier.  There  are  just  a  few  more 
questions  designed  for  the  communication  of  numerical 
values,  such  as  the  initial  and  the  (possible)  final  states, 
or  any  other  fixed  data. 


PERIOD  The  first  question  refers  to  the  length  of 

the  planning  horizon.  The  answer  must  be  of 
the  form 

name  from  a  to^  b  by^  c 

where  'name'  is  an  identifier  for  the  periods, 
and  a,b,c  are  integers,  c  being  optimal  and 
i  assumed  to  be  1  by  default. 

e.g. 

k  from  1  to  6 


RANDOM  Asks  the  user  to  define  the  possible  random 

variable  of  the  model.  The  answer  is  opti¬ 
mal  (when  no  answer,  skip  a  line)  and  of  the 


form 
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name  from  a  to  b  by  c 

where  'name'  is  an  identifier  including  the 
period  identifier  as  a  subscript,  and  a,b,c 
integers  defining  the  range  of  possible 
values . 

e.g. 

demand  (k)  from  2  to  4  by  2 


PROBABILITY  Asks  the  user  to  communicate  the  probabili¬ 
ties  for  each  possible  value  of  the  random 
variable.  Those  must  be  stationary,  i.e., 
valid  for  each  period.  The  answer  is 


a 


1 


e.g. 


0.5  0.5 

i 


where  a.  are  real  numbers 

l 


STATE  Asks  the  user  to  define  the  state  variable 

of  the  model.  The  answer  is  of  the  form 
name  from  a  _to  b  by^  c 

with  the  same  conventions  as  above 


e.g. 


inventory  (k)  from 


0 


to 


4 


- 
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INITIAL 


a 


e.  g. 

0 


Asks  the  user  for  a  possibly  fixed  initial 
state.  The  answer  is  optional  and  of  the 
form 

where  a  is  an  integer 


FINAL 


a 


e.g. 


0 


Asks  the  user  for  a  possibly  fixed  final 
state.  The  answer  is  optional  and  of  the 
form 

where  a  is  an  integer 


DECISION  Asks  the  user  for  the  definition  of  the 

decision  variable.  The  answer  can  be  one 
of  two  forms 

name  from  a  to  b  by  c 

or 

if  expression  then  name  from  a  to  b  by_  c 

Here  'expression'  defines  a  unique  state 
for  which  a  strategy  is  required  in  the 


case  of  a  stochastic  model. 
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e.g. 

production  (k)  from  0  to  5 
or 

i  f  inventory  (k)  =  0  then  production  (k)  from  0  to  5 

TRANSITION  Asks  the  user  for  the  transition  relation  for 

the  state  variable  from  one  period  to  another. 
The  answer  has  two  possible  forms 
if  expression  then  statement^  else  statement^ 

or  simply 
statement^ 

where  'expression'  is  a  PL/1  expression 
defining  a  possible  condition  and  'statement^' 
are  PL/1  statements  defining  the  transformed 
state  with  subscript  augmented  by  1 

i 

e.g. 

inventory  (k+1)  =  inventory  (k)  +  production  (k)  -  demand  (k) 

FUNCTION  Asks  the  user  for  the  definition  of  the 

economic  immediate  return  resulting  from  a 
decision.  The  answer  has  two  possible  forms 
if  expression  then  statement^  else  statement ^ 
or  simply 
s  tatement^ 
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Here  the  statements  define  possible  economic 
returns 

e .  g . 

if  production  (k)  =  o  then  cost  (k)  =  inventory  (k) 

else  cost  (k)  =  inventory  (k)  + 
production  (k) *2+13 

CONSTRAINT  Asks  the  user  for  the  definition  of  a  possible 

constraint  to  be  satisfied  by  the  state  and 
decision  variables.  The  answer  has  two  possi¬ 
ble  forms 

if  expression^  then  expression^  else  expression^ 

or  simply 

expression^ 

Here  ' expression ^ '  defines  a  possible  condi- 
*  tion  and  the  other  expressions  possible  con¬ 

straints 

e  .g. 

inventory  (k)  +  production  (k)  >=  4  &  inventory  (k)  + 

production  (k)  <=  6 

DATA  Asks  the  programmer  for  the  values  of  some 

fixed  data  appearing  in  the  above  PL/1 
expressions  and  statements.  The  answer  is 


' 


* 
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name  Csub  d  d  d  ... 

a.  u 

Where  'name1  is  an  identifier  for  the  data, 

'sub'  a  subscript  -  which  can  be  itself  the 

period  index,  or  one  of  the  variables  of  the 

model  -  and  d.  real  numbers  attributed  to 
1 

the  name.  Up  to  3  names  can  be  so  listed. 
Hit  the  return  key  to  terminate  the  answer. 


e  .g. 

d  emand  (k)  3  3  3  2  1  3 

increment  (production  (k) )  0  0  0 


0 


0  0  3.5 
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5  -  The  Control  Instructions 


A  few  instructions  allow  the  user  to  control  the 
flow  of  operations,  i.e.  to  direct  the  conversation.  They 
are  available  at  any  time  in  the  manual  mode  and  at  the  end 
o f  an  automatic  run. 


a  utomatic 

manual 

save  model  i 

retrieve  model  i 
list 

minimize 

maximize 

stop 


switches  the  system  into  the  automatic  mode 
switches  the  system  into  the  manual  mode 
stores  on  disk  the  model  and  assign  a 
key  1  <  i  <  3 

loads  from  disk  the  model  with  key  i 
produces  a  listing  of  the  model 
commands  the  minimization  of  the  model 
commands  the  maximization  of  the  model 
stops  the  activation  of  the  DYLAN  system 
and  switches  the  computer  into  the  normal 
PL/1  background.  This  facility  allows 
nested  PL/1  computation  within  the  use 


of  DYLAN 


go  to  resume  reactivates  the  DYLAN  system 

clear  data  erases  all  the  fixed  data  previously 


entered  in  the  DATA  statement 


. 
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6  -  An  Example  of  Sensitivity  Analysis  On-line 

The  example  chosen  to  illustrate  the  use  of  DYLAN  is  an 
elementary  production- inventory  model  found  in  [8].  It  will  be 
demonstrated  here  how  to  perform  in  a  straight-forward  manner 
the  detailed  sensitivity  analysis  presented  in  the  above 
reference . 

6.1  -  Statement  of  the  Problem  ([8]  p.  261-62) 

A  firm  wishes  to  establish  a  production  schedule  for 
an  item  during  the  next  time  periods.  The  manufacturing  time 
to  produce  a  batch  of  these  items  is  negligible,  so  that  pro¬ 
duction  in  a  given  period  can  be  used  to  fill,  entirely  or 
partially,  the  demand  in  that  period.  Since  the  demand 
requirements  do  vary  from  one  period  to  another  and  there  are 
certain  economies  of  batch  production,  it  is  often  economical 
for  the  firm  to  produce  more  than  it  is  needed  in  one  period 

t 

and  store  the  excess  until  it  is  required  later.  However 
there  is  a  cost  of  holding  the  resultant  inventory. 

The  objective  is  then  to  devise  a  schedule  that  mini¬ 
mizes  the  total  production  and  inventory  holding  costs  and 
which  meets  all  the  demand  requirements  on  time. 

6.2  -  Model  Formulation 

Suppose  first  that  the  planning  horizon  consists  of 
6  periods,  months  or  weeks,  depending  on  the  context.  The 


. 


' 
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inventory  level  at  each  period  k  is  taken  to  be  the  state 
variable,  and  the  quantity  to  be  produced  is  the  decision 
variable.  The  initial  and  final  inventory  are  constrained 
to  be  zero,  and  there  is  also  a  restriction  on  production 
capacity  and  storage  space,  thus  defining  the  range  of 
possible  values  for  the  two  variables.  The  transition  rela¬ 
tion  expresses  the  change  in  inventory  due  to  production  and 
shipment.  The  cost  function  is  a  sum  of  a  term  due  to  pro¬ 
duction  (including  a  set-up  cost)  and  of  a  linear  inventory 
holding  cost.  Finally  the  demand  is  first  supposed  to  be 
known  and  constant. 

Using  the  automatic  mode  of  operation  will  lead  to 
the  following  formulation,  where  the  capital  letters  refer 
to  computer  questions: 

an tomat i c 

PERIOn 

k,  from  1  to  6 

STATE 

j_n  ven  to  ry  (  k  )  from  0  to  4 

I  ’•!  I  T  I  AL 

0. 

FINAL 


0 


MU  !  j  *  "  • 
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DECISION 

£>roHuc t i on ( k )  on  0  to  5 
RANDOM 


PRODAB  I LITY 


TRANSITION 

j_n v en  t o  r  y  (  k  + 1 )  =  i  n  v e n  t o  r  y  (  k  )  +  p  r o  i u c  t  i  o n  (  k )  - r\ en an  A  C  k ) 
FUNCTION 


±f  product ! on ( k ) =0  then  cos t ( k ) = i nven tor y ( k )  else  cost(k)= 


CONSTRAINT 


i nventory(k)+oroHuct ion(k)*2+13 


DATA 

ierriand(k)  3  3  3  3  3  3  3 


nininize 


optimal  Return 

96 

OPTIMAL  POLICY 

4 

5 
0 

4 

5 


0 


. 
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6.3  -  Sensitivity  Analysis  on  the  Length  of  the  Planning 

horizon 

Following  reference  {8],  suppose  that  one  wants  to  know 
how  the  optimal  schedule  depends  on  the  length  of  the  planning 
horizon.  One  would  have  then  only  to  switch  to  the  manual 
mode  of  operation,  type  (in  capital  letters)  the  keyword  referring 
to  the  appropriate  computer  question,  and  then  redefine  the  para¬ 
meters.  The  definition  of  the  model  will  be  consequently  updated 
for  all  future  use,  unless  the  previous  version  had  been  stored 
on  disk. 

nanua 1 
PER  I  on 

k.  from  1  to  5 
minimize 

OPTIMAL  RETURN 

i 

79 

OPTIMAL  POLICY 

5 

5 

9 

5 


0 


' 
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6.4  -  Sensitivity  Analysis  on  the  Initial  Inventory 

One  is  here  interested  in  the  dependence  of  an  optimal 
schedule  on  the  level  of  the  starting  inventory.  The  command 
would  be  simply: 

J j: !  T  I  AL 

o 

rinln! ^ 

OPT | m; L  5  FT!  P." 

74 

r.  pj  i  m  j  np  !  ]  r  y 


n 

4 

5 


6.5  -  Sensitivity  Analysis  on  the  Production  Capacity 

Suppose  that  there  exists  a  way  of  increasing  the  pro¬ 
duction  capacity,  at  an  incrementally  large  cost  however  (by 
overtime  work  for  instance) . 


CC I S I 0M 


d  r o d u c t  i  o n  ( k )  t  r or ;  3  to  6 


FI  Cl  !  0:  ' 

if  pro  Sue t  i on ( k )  =  j  then  cost <k) -Inventory <  )  cost  CO  nvontor-.-CO 

l+or  duct  T  t  n  C  )*2  +  l  >  +  *vercost  (  product  I  onO  )) 

DATA 


overcos 


t  (  o  rod  Lie  t  i  on  (  k )  )  0  0  0  0  0  0  5  .5 


> 

) 
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PERIOD 

ii  from  1  to  6 
INITIAL 

.J 

m i n I  n i ze 

OPTIMAL  RETURN 

04.5  • 

OPTIMAL  POLICY 

C 

0 

'J 

V* 

0 

5 

0 

6.6  -  Sensitivity  Analysis  on  the  Demand  Requirements 

Suppose  that  the  demand  requirements  cannot  be  com- 

t 

pletely  determined  in  advance,  but  can  be  regarded  as  being 
independent  random  variables  with  a  stationary  discrete  pro¬ 
bability  distribution. 

In  this  stochastic  model,  the  inventory  cannot  be 
controlled  any  more,  in  particular  the  final  inventory  cannot 
be  specified,  but  constraints  can  be  introduced  such  that 
stockout  never  occurs  and  inventory  does  not  become  too  large. 
Finally  the  state  for  which  a  strategy  is  required  must  be 


specified. 


. 
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PERIOD 

k.  from  1  to  3 
RANDOM 

HemandCk)  fro;n  2  to  4  by  2 
PR03ABI LI  TV 

a.5  .5 


£1  NAL 


DECISION 

±f  i  nven  tory  ( k )  =0  then  ororluct  i  on  ( k )  fron  0  to  5 
CONSTRAINT 

j_nventory(k)+production(k)>=4  &  i nventory(k)+oroduotion(k)<=6 
:n  i  n  i  m  I  z  e 


OPTIMAL  EXPECTED  RETURN 
57.5 


OPTIMAL  STRATEGY  WHEN  IN  STATE  0  AT  CACM  OCRIOD 

5 

4 
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7  -  Programmer  1 s  Guide 

7.1  -  The  Structure  of  the  System 

The  DYLAN  system  consists  of  a  PL/1  program  implemented 
on  CPS,  a  Conversational  Programming  System  available  on  IBM 
computers.  When  calling  this  program,  as  explained  earlier, 
the  user  has  only  to  communicate,  i.e.  to  type,  an  appropriate 
formulation  of  his  model.  In  much  the  same  way,  when  using  a 
subroutine,  for  linear  programming  one  has  only  to  communicate 
appropriate  input  parameters.  The  difference  is  that  here 
numerical  coefficients  are  not  sufficient  to  describe  any  given 
dynamic  programming  model.  Thus  this  program  requires  the  use 
of  the  EVAL  function  of  PL/l-CPS ,  which  makes  it  possible  to 
read  arithmetic  as  well  as  logical  expressions  into  character 
strings,  and  then  to  evaluate  them. 

The  basic  structure  of  the  system  is  as  follows:  It 
consists  of  a  main  program,  DYLAN,  which  contains  the  declara¬ 
tions  and  initializations  of  arrays  and  acts  as  a  control  and 
return  point  for  4  external  subroutines,  DECODE,  COMPIL,  SUB 
and  EXEC,  respectively  called  in  that  order.  This  fragmenta¬ 
tion  has  been  imposed  by  the  CPS  system  which  cannot  accomo¬ 
date  procedures  requiring  more  than  3  pages  of  core  storage. 

The  logic  of  operations  goes  as  follows:  when  either 
a  keyword  (referring  to  a  particular  question)  or  a  control 


. 
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instruction  is  entered,  the  procedure  DECODE  is  first  activated, 
and  the  corresponding  question  or  instruction  identified.  If 
it  is  a  question,  then  the  control  is  passed  to  the  procedure 
COMPIL,  which  will  read  the  answer  and  gradually  build  the 
model  by  storing  the  pertinent  information  in  appropriate  arrays 
of  numbers  or  character  strings.  If  it  is  an  instruction,  then 
the  action  required  will  be  taken  by  DECODE  itself,  unless  an 
optimization  of  the  model  is  required,  in  which  case  the  con¬ 
trol  is  first  passed  to  the  procedure  SUB  and  finally  to  EXEC. 
The  subroutine  EXEC  contains  the  algorithm  for  the  optimiza¬ 
tion  of  the  model.  Its  input  parameters  are  the  arrays  con¬ 
taining  the  data  collected  by  the  procedure  COMPIL.  In  EXEC, 
standard  internal  names  are  given  to  all  variables  involved. 

Thus  the  model,  as  defined  by  the  user's  own  variables  names, 
must  first  have  its  variables  names  substituted.  This  is  done 
by  the  subroutine  SUB. 

When  a  line  is  read,  it  is  entered  in  the  character 
string  line .  The  answers  to  the  questions  are  kept  in  their 
original  form  in  an  array  called  text ,  which  can  be  stored  on 
disk,  retrieved  and  updated.  The  array  leng  contains  the 
length  of  each  of  the  character  strings  of  text. 

Acting  as  a  control  inside  subroutines,  the  indicator 
code  takes  values  as  follows: 

code  =  1  the  system  is  in  the  manual  mode 

code  =  2  the  system  is  in  the  automatic  mode 


code  =  3 


the  system  is  in  the  retrieve  mode 


* 


. 
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The  indicator  status  controls  the  linkage  of  external 


subroutines  as  follows: 


status  =  0  for  the  normal  sequence  of  subroutine 
calls 

status  =  1  for  deactivating  the  system 
status  =  2  for  processing  the  DATA  statement 
(whose  answer  can  be  extended  on  3 
lines,  as  explained  in  section  5) 
status  =  3  for  calling  the  optimization  of  the 
model 

Finally  the  value  of  the  index  n,  between  1  and  20 , 
indicates  which  question  or  instruction  is  currently  being 
processed.  In  addition,  in  the  DATA  statement,  the  index 
da  ,  between  1  and  3,  will  indicate  which  line  is  being  pro¬ 
cessed,  and  rank  which  fixed  data  have  been  identified. (see 


section  7.4) 


7.2  -  Implementing  and  Running  the  DYLAN  System 

To  implement  DYLAN,  each  external  procedure  must  be 
entered  separately  in  the  CPS  system,  by  first  typing  the 
corresponding  PL/1  program  (contained  in  Appendix)  and  then 
storing  them  on  disk  with  the  CPS  instructions 

save  (dylan,  key) 


save  (decode,  key) 
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To  run  the  system,  DYLAN  must  be  first  loaded  by  the 
CPS  instruction 

load  (dylan,  key) 

and  then  activated  by  the  PL/1  instruction 

call  dylan 

The  system  is  then  ready  to  accept  the  first  DYLAN 
instruction 

e.g.  automatic 

7.3  -  Writing  DYLAN  Programs 

When  writing  DYLAN  programs,  the  user  can  rely  on 
section  5,  'The  Formulation  of  Models'.  In  some  cases,  how¬ 
ever,  he  will  find  it  necessary  to  determine  what  the  system 
does  in  response  to  some  of  his  specifications,  or  to  check 
if  the  system  took  the  action  he  anticipated.  A  basic  under¬ 
standing  of  the  algorithm  involved  in  the  EXEC  routine  is 
then  required. 

Dynamic  programming  works  in  two  steps:  first  a 
partial  enumeration  of  feasible  solutions  takes  place  to  find 
the  optimal  decisions  associated  with  each  possible  state 
that  can  occur;  then  an  appropriate  scanning  of  these  deci¬ 
sions  is  performed. 

In  STEP  1  of  EXEC/  the  required  enumeration  is  done 
by  4  nested  loops:  one  for  the  periods,  with  index  K,  one 
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one  for  the  state  variable,  with  index  i,  one  for  the  decision 
variable,  with  index  j,  and  one  for  the  random  variable,  with 
index  1  (this  last  one  being  restricted,  of  course,  to  stochas¬ 
tic  models) .  These  loops  generate  values  in  the  admissible 
range  specified  by  the  user  in  his  definition  of  the  model,  and 
the  states  produced  by  the  transition  relation  are  always 
checked  against  the  admissible  values.  Constraints  are 
checked  outside  the  loop  generating  the  random  variable,  thus 
allowing  constraints  to  involve  only  state  and  decision  varia¬ 
bles,  as  indicated  in  section  5.  Final  states  are  checked 
inside,  and  thus  can  be  specified  even  when  they  depend  on  the 
random  variable. 

Backward  Dynamic  Programming  is  used,  so  that  at  any 
period  K  the  optimal  return  accumulated  from  the  end  of  the 
planning  horizon  up  to  period  K.and  K+l  are  kept  for  each 

possible  state  in  two  arrays,  _f  and  _fl  respectively.  The 
optimal  decisions  for  each  state  are  kept  in  an  array  called 
opt,  which  is  stored  on  disk  at  each  period. 

In  STEP  2  of  EXEC,  these  optimal  decisions  are  either 
traced  back  starting  at  the  initial  state,  in  a  deterministic 
model,  or  simply  printed  out  for  the  strategy  state  specified, 
in  a  stochastic  model.  Thus  an  initial  state  is  always  required 
in  a  deterministic  model. 

It  must  be  pointed  out  here  that  the  system  differen¬ 


tiates  between  capital  letters  and  small  letters.  Keywords 
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referring  to  questions  must  be  typed  in  capital  letters.  All 
other  typing  must  be  done  in  small  letters. 

7.4  -  Debugging  DYLAN  Programs 

Two  kinds  of  messages  will  result  from  errors  occuring 
in  the  formulation  or  optimization  of  models.  First  a  few 
error  conditions  can  be  detected  by  the  DYLAN  system  itself. 
ILLEGAL  INSTRUCTION  the  line  just  entered  is  neither  a 

valid  DYLAN  keyword  nor  a  control 
instruction 

B  LOCK  DATA  FULL  no  more  data  can  be  entered  using  the 

DATA  statement 

NO  FEASIBLE  SOLUTION  there  is  no  feasible  solution  to  the 

model 

After  this  type  of  message,  the  system  DYLAN  is  still 

i 

activated  and  ready  to  accept  the  next  instruction. 

On  the  other  hand,  syntactical  errors  can  be  detected 
by  the  CPS  system  only.  In  order  to  be  able  to  understand 
the  error  messages  produced,  it  is  necessary  at  this  point 
to  introduce  the  internal  notations  employed  throughout  the 
DYLAN  system. 

The  internal  names  given  to  the  variables  of  the 
models  are  as  follows  (capitalized  to  avoid  interference 


' 
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with  the  user's  own  variables  names) 


K  for  the  period  index 

X  for  the  state  variable 

Y  for  the  decision  variable 

Z  for  the  random  variable 

A,B,C  for  the  fixed  data  entered  in  the  DATA  statement 

The  user's  own  variables  names  are  entered  in  an  array 
called  name ,  in  the  same  order  as  above. 

The  parameters  specifying  the  possible  range  of  values 
are  entered  in  a  two-dimensional  array  called  par am,  the  3 
columns  of  which  contain  the  value  of  from,  to,  by ,  in  that 
order,  the  4  rows  referring  to  the  variables  K,X,Y,Z.  The 
initial,  final  and  strategy  state  are  stored  in  an  array  called 
state . 

The  probabilities  are  stored  in  an  array  called  jo_. 

i 

The  arithmetic  and  logical  expressions  are  entered  in  an  array 
called  expr ,  the  3  columns  of  which  contain  the  expressions  for 
if,  then,  use  in  that  order,  the  3  rows  referring  to  the  tran¬ 
sition  relation,  the  return  function  and  the  constraint,  respec¬ 
tively.  After  the  substitution  of  names,  the  expressions  are 
stored  in  a  similar  array  called  e_ . 

Finally  the  array  test  contains  indicators,  as  follows: 
test (1)  =1  if  the  model  is  stochastic;  0  otherwise 

test(2)  =1  if  the  initial  state  is  given;  0  otherwise 


' 
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test  (3)  =1  if  the  final  state  is  given;  0  otherwise 

test (4)  =1  if  the  model  is  constrained;  0  otherwise 

test (5)  =1  if  the  model  must  be  maximized;  0  otherwise 

When  appearing  in  an  error  message,  the  contents 
of  these  arrays  can  be  checked  by  typing  CPS  instructions. 

e.g.  ?  name (4)  asking  for  the  name  of  the  random 

variable 

?  e(2,3)  asking  for  the  else  expression  of 

the  return  function 

The  DYLAN  system  can  be  reactivated  by  the  instruction 


go  to  resume 
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8  -  Performance  and  Limitations 

The  performance  of  the  DYLAN  system  in  terms  of  speed 
of  response  is  highly  limited  by  the  interpretive  execution  of 
the  CPS  system  itself.  Clearly,  the  optimizing  phase  of  DYLAN 
(in  the  procedures  SUB  and  EXEC)  should  not  be  supported  by  an 
interpreter.  Thus,  in  its  present  status,  DYLAN  is  far  from 
being  a  satisfactory  fool.  It  is  merely  a  demonstration  of 
what  could  be  achieved  through  a  system  based  on  an  effective 
combination  of  interactive  and  compiler-oriented  execution. 

The  arithmetic  within  DYLAN  is  carried  with  6  signifi¬ 
cant  digits,  thus  allowing  in  principle  for  values  between 
-999999  and  +999999.  However,  due  to  the  nature  of  Dynamic 
Programming  algorithm  itself,  variables  are  not  allowed  to 
take  more  than  101  possible  values,  integer  and  positive  or 
null,  thus  necessiting  a  discretization  of  their  range  by  the 

t 

from  a  _to  b  by_  c  scheme,  where  a  ^  b,  and  c  =  1  by  default. 
Furthermore,  if  a  variable  is  used  as  a  subscript,  then  its 
value  must  be  comprized  between  0  and  100. 

Finally,  for  disc  storage  capacity  reasons,  the  number 
of  periods  in  the  present  implementation  is  limited  to  41, 
though  the  system  is  programmed  to  accommodate  101  periods 


also. 
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